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ABSTRACT 


2.  FIR  ENERGY  COMPACTION  PROBLEM 


Energy  compaction  has  proven  to  be  an  essential  concept  in 
signal- adapted  data  compression.  In  particular,  optimiza¬ 
tion  of  orthonormal  subband  coders  for  a  given  power  spec¬ 
trum  directly  leads  to  optimal  energy  compaction  filters.  In 
this  paper,  we  consider  some  new  design  methods  and  prop¬ 
erties  of  optimal  FIR  energy  compaction  filters.  In  partic¬ 
ular,  we  propose  a  very  efficient  method  called  the  window 
method  for  the  general  M-channel  case.  The  method  does 
not  involve  any  sophisticated  optimization  tools  and  termi¬ 
nates  in  a  finite  number  of  elementary  steps.  Compaction 
gains  achieved  by  the  method  are  very  close  to  the  optimal 
ones.  As  the  filter  order  increases  the  filters  of  the  proposed 
method  converge  to  the  optimum  ideal  compaction  filters. 


1.  INTRODUCTION 

The  energy  compaction  problem  has  recently  attracted  con¬ 
siderable  attention.  It  is  sho^m  that  optimal  orthonormal 
(paraunitary,  PU)  filter  banks  that  maximize  coding  gain 
consist  of  optimal  energy  compaction  filters  [2,  8,  9,  12]. 
If  the  number  of  channels  is  higher  than  two,  this  connec¬ 
tion  is  made  for  the  case  where  the  filters  are  allowed  to 
be  ideal.  In  the  special  two-channel  case  however,  even 
vnth  FIR  constraint,  the  optimal  PU  filter  bank  problem 
is  equi\^ent  to  the  optimd  energy  compaction  problem. 
More  recently  a  number  of  authors  have  considered  the  FIR 
energy  compaction  problem  [1,  6,  7,  10,  13]  (see  [5]  for  fur¬ 
ther  references).  An  M-channel  FIR  compaction  filter  can 
be  considered  as  one  filter  of  an  M-channel  FIR  PU  filter 
bank. 


Let  H(z)  be  an  FIR  filter  of  order  AT.  Consider  Fig.  1  where 
the  input  x(n)  is  a  zero-mean  WSS  random  process  with 
power  spectral  density  5ix(e^‘^).  The  output  of  the  filter 

x{n)  vi^i) 

Figure  1.  The  FIR  energy  compaction  filter. 

is  decimated  by  M  to  produce  y(n).  The  optimum  FIR 
energy  compaction  problem  is  to  maximize  the  variance 


=  P  (1) 

of  y{n)  subject  to  the  Nyquist(M)  condition  [ll]  on 
de^'^)  =  Let  the  impulse  response  of  G(e-^‘^) 

be  y(n).  Then,  the  Nyquist(M)  condition  is  g{Mn)  =  j(n). 
Notice  that  by  definition  (7(6^*^)  >  0.  Define  the  com¬ 
paction  gain  as 


Gcomp(M ,  AT) 


(2) 


where  is  the  variance  of  x(n).  The  aim  therefore  is  to 
maximize  the  compaction  gain.  As  described  in  [5],  the  case 
where  N  <  M  and  the  case  where  ideal  filters  are  allowed 
(N  =  oo)  are  solved  analytically.  Our  interest  is  therefore 
for  the  case  where  M  <  N  <  oo.  Interestingly  enough,  the 
Tvindow  method  that  we  propose  involves  two  stages  that 
can  be  associated  with  the  above  tw^o  extreme  cases. 


3.  OVERVIEW  AND  PROPERTIES 


In  this  paper  we  consider  some  new  design  methods  for 
FIR  compaction  filters.  In  particular,  we  propose  a  method 
called  the  window  method  which  has  the  advantage  that 
no  optimization  tools  or  iterative  numerical  techniques  are 
necessary.  The  solution  is  generated  in  a  finite  number  of 
elementary  steps,  the  crucial  step  being  a  simple  comparison 
operation  on  a  finite  frequency  grid.  Combined  with  the 
fact  that  the  solution  is  close  to  optimal,  the  method  offers 
an  attractive  alternative  to  linear  programming  [6]. 
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Similar  to  the  IFIR  design  techniques  in  conventional  filter 
theory,  one  can  design  the  compaction  filters  in  multiple 
stages  if  M  is  composite,  e.g.,  M  =  MoMi.  This  leads  to 
efficiency  in  both  design  and  implementation.  The  details 
of  multistage  compaction  are  presented  in  [4]  (see  also  [5]). 

For  the  two-channel  case,  the  optimal  FIR  compaction 
filter  can  be  constructed  analyticdly  for  some  classes  of 
WSS  random  processes.  The  method  involves  representa¬ 
tion  of  positive  definite  sequences  and  has  connections  to 
other  mathematical  tools  such  as  line-spectral  theory  and 
Gaussian  quadrature  formula.  The  reader  is  referred  lo  [5] 
for  further  details. 
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In  the  next  section  we  propose  a  very  efficient  and  fast 
algorithm  (\snndow  method)  to  design  Af -channel  FIR  com¬ 
paction  filters  for  any  given  input  power  spectra.  This  does 
not  involve  numerical  optimization  techniques  such  as  linear 
programming  or  quadratic  constrained  optimization,  and 
has  finite  number  of  elementary  steps.  Before  describing 
the  method  in  detail,  let  us  briefly  mention  some  properties 
of  optimal  FIR  compaction  filters: 

1.  A  necessary  condition  on  the  compaction  filter 
for  optimality.  For  an  FIR  compaction  filter  H{z)  to 
be  optimum  it  is  necessary  that  the  FT  of  the  sequence 
r{n)g*{n)  attains  its  maximum  at  the  frequency  w  —  0, 
where  ^(n)  is  the  impulse  response  of 

2.  Monotonic  behaviour  of  the  optimum  FIR  com¬ 
paction  gain.  Let  denote  the  optimum 

compaction  gain  for  a  given  number  of  channels  M  and 
FIR  filter  order  N.  It  is  then  clear  that  Gopt{M,N)  < 
Gopi{kM,N)  and  Gopt{M,N)  <  Gopt{M,N -h  1). 

3.  Bounds  in  terms  of  eigenvalues.  Let  fiin)  be  any 
Nyquist(M)  sequence  '^nth  nonnegative  Fourier  series  coef¬ 
ficients.  Assume  L>  N.  Then, 

Amar|r(n)/£(n)|^  <  GoptiMyN)  <  Amar|r(n)|^  .  (3) 

Here  the  notation  Amai|r(Ti)  j  stands  for  the  maximum 
eigenvalue  of  the  Hermitian  Toeplitz  matrix  whose  first  row 
is[r(D)r(l)  ...  r(N)]. 

4.  Upper  bound  by  M.  For  all  FIR  compaction  filters 
we  have 

-  Gopt{M,N)<M  (4) 

with  strict  inequality  as  long  as  Sxz{^^  )  is  not  a  line- 
spectral  process,  and  A’'  is  finite. 

For  all  proofs,  see  [5]. 

4.  WINDOW  METHOD 

The  idea  behind  the  window  method  is  to  represent  the 
impulse  response  of  G{e^^)  =  in  the  form 

g{n)  =  w(n)fL{n)j  (5) 

where  the  window  w;(n)  has  the  same  length  as  p(n),  namely 
2 A'’  -h  1  and  the  sequence  fL{n)  is  periodic  vnih  period  L  = 
KM  >  2N  for  some  K  (see  Fig.  2). 


Figure  2.  Decomposition  of  g{n)  as  w{n)fL{n). 

Let  FL{k)  =  be  the  Fourier  series  co¬ 
efficients  of  fiin).  Here  Wl  =  It  can  easily  be 

verified  that  if 

1.  w{n)  and  /L(n)  are  conjugate  symmetric,  i.e.,  ui(n)  = 
hin)  =  /2(-n),  and  ui(0)  =  /i,(0)  =  1, 


2.  the  FT  lV(e'’")  of  w(n)  is  nonnegative  Vw, 

3.  the  FS  coefficients  Fi(fc)  are  all  nonnegative,  and 

4.  the  sequence /L(n)  is  Nyquist(M), 

then  g{Mn)  =  5(n)  and  G(e^'")  >  0.  That  is,  any  spectral 
factor  of  G(e'")  is  a  valid  compaction  filter. 

Let  us  assume  that  the  above  conditions  hold.  If  win)  is 
fixed,  what  is  the  best  /t(n)  that  maximizes  the  compaction 
gain?  To  answer  the  question  we  first  note  the  following: 

Lemma.  A  periodic  sequence  /i,(n)  with  L  =  KM  is 
Nyquist(M),  if  and  only  if 

M-l 

Y^FLik  +  iK)  =  M,  k  =  0,...,K-l.  (6) 

i=0 

Let  r(n)  =  u;*(n)r(n)  and  let  5i,(fc)  be  the  FS  coefficients 
of  its  periodic  expansion  f£,(n).  For  simplicity  assume  that 
L  >  2N.  Then  <7*  in  1  becomes  ffj  =  Uin)flin)  = 

Piik)SL{k).  Notice  that  both  F^k)  and  SUk) 
are  real.  Now  to  incorporate  the  Nyquist(A/)  constraint  we 
write  the  preceding  as 

JC-l  Af-l 

i  iK)SL{k  +  iK)  (7) 

fc=0  i=0 

For  a  fixed  it,  let  Stik  -f  be  the  maximum  of  the  set 
{SUk  +  iK),  i  =  0, . . . ,  Af  ~  1}.  Then  by  (6),  and  noting 
that  FUk)  >  0,  the  objective  (7)  is  maximized  if  we  assign 
Fiik  -h  ioK)  =  Af,  and  -f  iiK)  =  0,  /  =  1, . . . ,  Af  —  1. 
The  procedure  is  illustrated  in  Fig.  3.  By  repeating  the  pro- 
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Figure  3.  The  procedure  to  find  5l(0)  is  maximum 

among  {5L(tAr)}»  hence  Fi,(0)  =  Af,  Fl(IK)  =  0, /  ^  0. 
5l(1  +  if)  is  maximum  among  {5l(1  +tif)},  hence  Fl(1  -h 
if)  =  Af ,  Fl(1  +  fif)  =  0,  /  1,  and  so  on. 

cess  for  each  it  =  0, . . . ,  if  ~  1,  the  Fourier  series  coefficients 
of  the  best  /L(n)  is  determined.  The  sequence  /j:(n)  can 
now  be  calculated  by  /L(n)  =  ^ 

Algorithm  for  the  window  method 

Assume  a  window  tz;(n)  of  the  same  length  as  g[p)  v-dth 
nonnegative  Fourier  transform  has  been  chosen.  Let  L  = 
KM  >  2  AT.  Then  the  algorithm  steps  are 

1.  Calculate  SUk)^  the  DFT  coefficients  of  fL(n),n  = 
0, . . . ,  L  —  1,  where  rtin)  the  periodical  expansion  of 
f(n)  =  u;*(n)r(n). 


2.  For  each  it  =  0, . . . ,  A*  -  1,  determine  the  index  io  for 

which  Siik  +  ioK)  is  maximum,  and  assign  + 

ioK)  =  M  and  FLik  +  iiK)  =  0,  /  =  1,. . . , M  -  1. 

3.  Determine  /L(n)  and  form  ^(n)  =  w(n)fL{n), 

4.  Spectrally  factorize  G{z)  to  find  H{z). 

If  the  input  is  real,  the  above  algorithm  can  be  modified 
to  produce  real-coefficient  compaction  filters.  In  this  case 
the  window  is  chosen  to  be  real.  Let  P  =  if  /C  is 
even,  and  P  =  if  it  is  odd.  Then  the  algorithm  for  the 
real  process  replaces  step  2  by  the  follo'^ing  two  steps: 

1.  For  each  fc  =  0, . . . ,  P,  determine  the  index  io  for  which 
Siik  -h  io^^)  is  maximum, 

2.  If  k  -h ioK  =  0  or  +  ioK  =  j  then  set  Fii^k  H-  ioK)  = 
M,  else  if  A;  =  0  or  =  y,  then  set  F{k  -h  ioK)  = 
F{L  ~  Jt  -  ioK)  =  else,  set  F(A:  4-  ioK)  =  F{L  - 
k  —  ioK)  =  M.  Set  all  the  remaning  v’alues  to  zeros. 

Optimization  of  the  window 

If  we  fix  /L(n),  what  is  the  best  window  w{n)?  The 
objective  (1)  can  be  written  as 

=  y"  (8) 


where  Sxzie^'^)  is  the  Fourier  transform  of  /*(7i)r(n)  where 
/(n)  is  one  period  of  /i(n)  centered  at  n  =  0.  Let  W = 
|A{e^")|*,  where  A{z)  =  spectral  fac- 

tor  of  The  only  constraint  on  is  that  it  has 

to  have  unit  energy  in  view  of  ii;(0)  = 

Hence,  by  Rayleigh’s  principle  [3],  (8)  is  maximized  if  A{z) 
is  the  maximal  eigenfilter  of  P.  The  corresponding  com¬ 
paction  gain  is  the  maximum  eigenvalue  of  P. 

We  have  described  how  to  optimize  t/;(n)  given  /L(n),  and 
vice  versa.  It  is  reasonable  to  expect  that  one  can  iterate 
and  obtain  better  compaction  gains  at  each  stage.  We  have 
observed  in  most  examples  that  two  stages  of  iterations  were 
sufficient  to  get  near-optimal  compaction  gains.  We  started 
with  a  triangular  window  and  found  that  /L(n)  did  hot 
change  after  the  reoptimization  of  the  window.  Notice  that, 
the  use  of  an  initial  \^dndow  is  not  necessary  if  one  is  nulling 
to  use  a  window  after  finding  /l  («)•  However,  in  most  of  the 
design  examples  we  considered,  we  have  observed  that  using 
an  initial  window  with  nonnegative  Fourier  transform  (in 
particular,  the  triangular  window)  and  then  reoptimizing 
the  window  resulted  in  better  compaction  gains. 

Example  1:  MA(1)  process.  Let  iV  =  5,  M  —  4,  r(0)  = 
1,  r(l)  =  p,  and  r(n)  =  0,  n  >  1.  Assume  the  process  is 
real  so  that  r(~7i)  =  r(n).  Let  the  window  be  triangular, 


i.e., 


n  =  0,  ±1,  ...,  ±5 
elsewhere. 


(9) 


The  Fourier  transform  of  f(n)  =  w{n)r{n)  is  5(6^*^)  = 
1  -h  fpcoso^.  Hence,  the  DFT  coefficients  Siik)  of  f(n)  in 
step  1  are  S'l(A:)  =  1  -F  fpcos('^A:),  k  =  0, ...,L  —  1. 
Now,  assume  L  =  12  >  10,  so  that  F  =  3  and  P  = 
1.  So  we  have  the  following  sets  to  consider  in  step  2: 
{5L(0),5L(3),St(6),SL(9)},{5i.(l),Si(4),5t(7),SL(10)} 


which  are  evaluated  as  {1+fp,  1, 1  — fp,  1},  {1+^^Pi  1  — 

1  _  ^p,  1  +  |p}.  First  assume  p  >  0.  The  maximum 
of  the  first  set  is  5l(0)  and  the  maximum  of  the  second  set 
is  5l(1)*  Hence  applying  step  3  of  the  algorithm  we  have 
{FL(k),  k  =  0,...,L-1}  =  {4, 4, 0,0, 0,0, 0,0, 0,0, 0,4}. 
This  determines  /r  (n),  and  G{z)  =  ^  -h  -h  + 
+  1  +  +  iz-3  +  l^z-\ 

The  corresponding  compaction  gain  is  1  +  ~ 

1  -h  1.5178p.  An  optimum  compaction  filter  H{z)  is  ob¬ 
tained  by  spectrally  factorizing  G{z).  If  p  <  0,  it  can  be 
verified  that  the  resulting  filter  will  be  H{-z)  where  H{z) 
is  the  solution  for  the  previous  case. 

For  comparison,  we  have  also  designed  an  optimum 
compaction  filter  using  the  linear  programming  technique. 
The  corresponding  compaction  gain  is  approximately  1  -f 
1.6657|p|.  This  is  achieved  by  using  L  =  512  and  a  trian¬ 
gular  window  of  order  L-N-h  The  compaction  gain  of 
the  window  method  is  only  slightly  lower.  Let  us  find  the 
improvement  we  can  get  by  optimizing  the  window  when  we 
fix  ftin).  The  compaction  gain  is  the  maximum  eigenvalue 
of  the  6  X  6  symmetric  Toeplitz  matrix  with  the  first  row 
[1  /l(1)  p  0  0  0  0].  This  eigenvalue  is  1  -h  1.8019/l(1)|p1* 
Using  /l{1)  from  the  above  calculations,  the  improved  com¬ 
paction  gain  is  l-hl.6410|p|  which  is  very  close  to  the  linear 
programming  compaction  gain  1  -f  1.6657|p|. 

Given  this  optimal  \<,dndow,  can  we  improve  the  com¬ 
paction  gain  further  by  reoptimizing  /L(n)?  In  this  and 
all  the  other  design  examples  v:e  considered,  we  used  the 
triangular  window  and  then  found  the  optimum  /l(7i),  and 
then  reoptimized  ti;(n)  for  Interestingly  enough,  the 

reoptimization  of  /l(7i)  did  not  change  it! 

Choice  of  the  periodicity  L 

Increasing  L  does  not  necessarily  increase  the  resulting  com¬ 
paction  gain.  For  example  using  L  =  oo  which  corresponds 
to  using  optimum  ideal  filter  /i(ti)  for  the  autocorrelation 
sequence  tl  (ti)  does  not  result  in  the  best  achievable  com¬ 
paction  gain  using  the  algorithm.  This  is  true  even  if  no 
initial  window  is  used.  For  the  above  example,  we 

increased  L  to  16  and  found  that  the  compaction  gain  de¬ 
creased!  When  we  used  the  idecd  filter  for  ftin)  which  cor¬ 
responds  to  L  =  00,  the  compaction  gain  was  better  than 
that  of  the  case  L  =  16  but  worse  than  that  of  the  case 
L  =  12. 

Until  this  point  we  assumed  that  L  >  2N,  If  we  use 
a  period  L  that  is  the  smallest  multiple  of  M  such  that 
L  >  2iV,  then  we  obtain  very  good  compaction  gains.  This 
choice  can  be  compactly  written  as 

L  =  M\2N/M]  (10) 

If  L  =  2A^,  the  sequence  fz,(n)  has  the  following  first  period: 

{r(0),f(l), . . .  ,f(7V)  +  f*(N), . . .  (1)}.  (11) 

In  this  case,  'v^'e  have  =  2f(Ar).  This  will  always  be 

the  case  if  M  =  2,  since  L=^2N  is  a.  multiple  of  M, 

Connection  between  the  linear  programming*  and 
window  methods 


As  explained  in  [5],  in  the  linear  programming  method, 
one  finds  a  sequence  whose  Fourier  transform  is  nonnega¬ 
tive  only  at  a  prescribed  set  of  frequencies.  To  assure  the 
nonnegativity  of  C7(e^‘*^),  one  modifies  this  solution  by  win¬ 
dowing  it.  When  L  is  a  multiple  of  M,  a  periodic  sequence 
p£,(n)  in  the  linear  prograLraraing  method,  and  a. periodic 
sequence  /i:(n)  in  the  window  method  are  found  such  that 
they  are  Nyquist(M)  and  their  Fourier  series  coefficients 
are  all  nonnegative.  For  L  >  2N,  two  problems  axe  not  the 
same  because  pL(n)  is  necessarily  zero  for  some  n,  while 
//,(n)  can  be  nonzero  for  all  n  (except  n  =  kMy  of  course). 
If  however  L  =  2Ny  then  the  two  problems  are  exactly  the 
same!  If  windowing  is  done  in  the  same  way  in  both  meth¬ 
ods,  then  we  see  that  the  resulting  compaction  gains  should 
be  the  same.  Hence,  one  can  view  the  window  method 
as  an  efficient  and  noniterative  technique  to  solve  a  linear 
programming  problem  when  L  —  2N,  If  L  is  inreased, 
we  saw  that  the  wndow  method  does  not  necessarily  yield 
better  gains  whereas  this  is  the  case  for  the  linear  program¬ 
ming  method  provided  the  window  order  is  increased  as 
w'ell.  How^ever,  optimization  of  the  window^  becomes  costly 
as  the  order  increases.  If  one  uses  a  fixed  triangular  window 
(with  a  high  order)  in  the  linear  programming,  and  if  the 
window^s  are  optimized  in  the  window  method,  then  window 
method  is  very  close  and  sometimes  superior  to  the  linear 
programming  method  as  w’e  demonstrate  in  the  following 
example. 

Example  2;  Comparison  of  linear  programming  and 
window  methods.  We  have  designed  compaction  filters 
for  an  AR(5)  input.  The  psd  and  the  magnitude  square  of 
a  compaction  filter  for  (M,  A^)  =  (2, 65)  designed  by  linear 
programming  are  shown  in  Fig.  4.  In  Fig.  5(a)  w’e  plot  for 


frequency/pi 


Figure  4.  The  psd  of  an  AR(5)  process,  and  the  magnitude 
square  of  an  optimal  compaction  filter  designed  by  linear 
programming  (M  =  2,  N  =  65). 

M  =  2,  the  compaction  gains  of  both  the  linear  program¬ 
ming  and  the  window  method  versus  the  filter  order. 

The  number  of  frequencies  used  in  the  linear  program¬ 
ming  method  is  L  =  512  while  the  periodicity  used  in  the 
window-  method  is  L  =  2N,  The  window-s  used  in  the  linear 
programming  are  triangular  windows  with  order  L  —  AT  —  1. 
In  the  window-  method,  the  autocorrelation  sequence  is  first 
windowed  by  a  triangular  window  of  symmetric  order  N  to 
find  /L(n)  and  then  the  window  is  reoptimized. 

From  the  figure  we  observe  that  if  the  order  is  high, 
one  has  slightly  better  compaction  gains  using  the  window 
method.  This  implies  that,  if  one  optimizes  the  window, 
there  is  no  need  to  use  large  number  of  frequencies  in  the 
linear  programming  method!  More  importantly,  there  is  no 
need  to  use  the  linear  programming  technique  for  high  filter 


(a) 


Figure  5.  Comparison  of  the  window  and  line^  program¬ 
ming  methods,  (a)  Compaction  gain  vs.  filter  order,  M  =  2, 
(b)  Compaction  gain  vs.  number  of  channels,  N  =  65. 

orders.  Notice  that  for  high  filter  orders  linear  programming 
method  has  prohibitively  large  computational  complexity. 

In  Fig.  5(b),  we  show  the  plots  of  the  compaction  gains 
of  the  tw-o  methods  versus  M  for  AT  =  65.  We  observe 
that  the  w-ifidow  method  performs  very  close  to  the  linear 
programming  method  especially  for  low  values  of  M.  We 
show  the  upper  bounds  on  compaction  gains  in  both  plots. 
The  upper  bound  in  the  first  plot  is  achieved  by  an  ideal 
compaction  filter  and  that  in  the  second  plot  is  achieved  by 
a  maximal  eigenfilter  [5]. 
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